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ABSTRACT 

Instructional Accomplishment Information ( lAI ) 
systems provide schools and school districts with information for 
reviewing and planning their instructional programs at the class, 
school, and district levels. This study demonstrated the use of lAI 
information to illuminate further the instructional accomplishments 
of schools priority program to which a district is committed. One of 
the procedural principles suggested by Milazzo, Buchanan, and Schutz 
(1981) for analyzing lAI district level databases in Racially 
Isolated Minority (RIM) school or other special priority program 
context was to identify those students who register instructional 
accomplishments at or above the average for non-RIM (or non-program) 
students. The procedure was applied to 89 Hispanic RIM schools in the 
Los Angles Unified School District relative to the accomplishment 
information yielded by the District ' s 1980 Survey of Essential 
Skills. Demonstrating that the procedure was practical, the findings 
showed that: a 5% random sample of student records was adequate to 
preliminarily identify such schools; the procedure revealed 
substantial positive accomplishments in Hispanic RIM schools; the 
accomplishments did cluster in some RIM schools more than others; and 
schools and schooling practices did make a difference in attaining 
instructional accomplishments. (NQA) 
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lAI Information and Priority District Programs: A Case Study 
Involving the Instructional Accomplishments of Hispanic Students 
in Racially Isolated Schools 

Barry Bachelor 

ABSTRACT 

Instructional Accomplishment information (lAl) systems are designed to 
provide school districts with Information for reviewing and planning their 
instructional programs. This study outlines and demonstrates a methodology 
for using lAI information to illuminate further the instructional accomplish- 
ments of schools priority program to which a district is committed. This 
methodology is one aspect of that described by Milazzo, Buchanan and Schutz 
(1981) for analysis of district level data bases* The particular context 
for demonstration is that of Hispanic Racially Isolated Minority Schools 
(RIMS). The study shows that there are substantial instructional accomplish- 
ments in Hispanic RIM schools and that the accomplishments do cluster in some 
schools more than others. That is, some Hispanic RIM schools are more 
effective than others and this study identifies the effective subset* 



lAi INFORMATION AND PRIORITY DISTRICT PROGRAMS: A CASE STUDY INVOLVING 
THE INSTRUCTIONAL ACCOMPLISHMENTS OF HISPANIC STUDENTS IN RACIALLY 
ISOLATED SCHOOLS 

Barry Bachelor 

Instructional Accompi I shment Information (lAl) systems are designed 
to provide schools and school districts with Information for reviewing 
and planning their instructional programs at the class, school, and 

f 

district levels. The distinctive features of lA! systems are discussed 
by Milazzo and Buchanan (1980). Milazzo, Buchanan, and Schutz (I98I) 
also describe a methodology for instructional interpretation and 
planning at the district level while Behr and Yee (1982) describe a 
complementary methodology at the class and school level. 

The purpose of the present study is to demonstrate one of the 
interpretation and planning uses at the district level: Using lAI 
information to illuminate further the instructional accomplishments of 
schools priority program to which a district is committed. The 
particular context chosen for demonstration is that of Hispanic Racially 
Isolated Minority Schools (RIMS) in the Los Angeles Unified School 
District. 

The methodology demonstrated is one aspect of that described by 

Milazzo, Buchanan, and Schutz (198l) for analysis of district level data 

bases. One of the key principles in the methodology Is to isolate 

instructional accomplishments and then to track down the school and 

classroom practices that lead to the identified accomplishments: 

The commitment is to isolating RIMS accomplishments, and not just 
because it is beneficial to point to them— although that would be a 
refreshing change for RIMS. The intention Is to isolate RIMS 
accomplishments so that they can be traced back to practices that 



schools have som« control over .... The research Is for what 
works In RIMS, to find It and hang onto It, and to<generan2e It to 
other RIMS P. 7-8 . 



One suggested procedural step for Isolating the accomplishments Is 
to " Identify those RIMS students who have accompli sivnent scores that are 
at or above the district average; or, even better, at or above the 
average for non-RIMS students" (p. 7). The present report describes the 
results of applying the suggested procedural step in Identifying "RIMS" 
accomplishments of Hispanic students based upon accomplishment 
Information generated and accumulated In the Los Angeles Unified School 
District during the 1979-80 school year. 



Background? I98O Survey of Essential Skills 

Beginning In 1979, the Los Angeles Unified School District In 
collaboration with SWRL has developed, Installed, and operated an lAi 
system. The system has several components: 

m Survey of Essential Skills (SES) 

The SES are Instruments for obtaining Instructional accomplish- 
ment informatloi in Reading, Mathematics, and Composition for 
grades 1, 2, 3, ^, 5, and 6, They are administered to all 
elementary school students each May* They register student 
accompl Ishrronts on the skills deemed essential for grade*by- 
grade progress in each subject area. The student materials are 
supported by teacher materials, Inservlce materials, etc* 

# SES Reporting System 

The completed SES instruments are machine scannable so that 
results can be quickly processed and reports pr^par^6 for each 
individual student, for each school aggregrated by grade level 
within school, for each a<*plni strati ve area, and for the 
district as a whole* The computer software for scanning and 
processing the results is Installed on the District *s computer 
and Is tjperated by District personnel. The reporting system is 
supported by appropriate prln(^^and Inservlce materials. 



• SES 51 Sample 

As part of the computer processing* approximately §1 of the 
individual student records are randomly selected and stored !n a 
separate archival file for research purposes. Each student 
record contains demographic and accomplishment Information as 
fol lows: 

Demographic Accomplishments 

1. Attendance Information For each subject area-- 

Readlng, Hathematicst 

2. Home School Code Composition: 

3. Ethnicity 1. Item responses 

k. Sex 2. Skill area performance 

Including writing s^ple 
5. Language Fluency (as performance at grades 3 

applicable for bilingual and 6 

program considerations) 

i 3. Total performance 

This S% sample Is used as the data base for the analyses 
performed in this report. 

Classifying Schools by Student Language Classification Categories 

For the present analysis, only those schools that had a two-thirds 
majority Hispanic enrollment and were designated as RIM schools were 
considered. There were 89 such schools In the data base. These 89 
schools were then further subdivided Into two types according to the 
proportions of FES (Functional English Speaking) and NES/LES 
(Non-English Speaking/Limited English Speaking) students In the school. 
This Information Is summarized In Table 1. 



Table t 
School Characteristics 



Main Character! St tcs of 89 Schools 

Designated "RiM*' (Racially Isolated Minority) by the 
court 

Two-thirds or more Hispanic enrollment 



Type 1 Schools (63rflchools) 

• two-thirds or more of Hispanic students in school 

classified as FES (Functional English Speaking) 

• Average over 63 Schools: 82% Hispanic 

79% FES 



Type 2 Schools (26 schools) 

• one-third or more of Hispanic students in school 

classified as NES/LES 

• Average over 26 schools? 82% Hispanic 

51% NES/LES 



The remainder of the analysis in this report is confined to Type 1 
schools {FES Hispanic RIM) because of the school district's testing 
policy. The policy requires every FES student to be assessed at every 
grade level. Students classified as NES/LES are not to be tested except 
at Grade 6. Consequently, there are "full" data sets only for Type 1 
schools, and It is these data sets upon which the analysis focuses. 

Identifying Patterns of School Performance 

Once the set of 63 FES Hispanic RIM schools had been Identified, 
the next step ^as to Identify their overall performance relatfve to non- 
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RiM schools. For simplicity, performance of the District's white 
students was used as ^he proxy for tt>e ^'performance of non-RIH schools." 

When RIM schools are compared with 'Sirhlte" schools, scores for the 
overall group of white students Is predictably hfgher than for the 
overall group of RIH schools (Hllazzo, Buchanan, & Schutz, 1981). 
However, many Hispanic RIM students are performing above the white 
student average. The approach taken In this paper Is to Identify those 
Hispanic RIM schools (Type 1) that have a relatively large proportion of 
students performing at or above the average level for white pupils. An 
example illustrates the procedure. 

In fourth grade mathematics the average district-wide percentage 
for white pupils Is 80%. The average district-wide for Hispanic FES 
pupils is 68%. However, approximately one-third (33.5%) of the Hispanic 
FES pupils in the district performed above 80%. Further, "high scoring" 
Hispanic FES pupils attending RIM schools were enrolled in only 6^% of 
the RIM schools, in other words, 36% of the Type 1 RIM schools had no 
Hispanic FES pupils performing above the white pupil average In fourth 
grade mathematics. 

To determine whether a school had a large proportion of "high 
scoring" pupils, the d'strict-wlde proportion of Hispanic FES students 
exceeding the average "white" student score was used as the cut-off 
point. If a school's proportion of high scoring pupils in a particular 
grade and subject area exceeded the district proportion, It was simply 
given one point. The number of points was then siwwned for each school 



•cross all subjects and grades. Because there are 6 grades and 3 
subjects, each school can "score" anywhere from 0 to 18 "points." 

in the previous example, district-wide, 33*St of the Hispanic FES 
pupils exceeded the white mean of 80| correct in fourth grade 
mathem!<t{cs. Each school in the sample was examined to see if Its 
proportion of high scoring pupils was at or above the district-wide 
prs>fortion of 33. 5i* if it was, the school was assigned one point. 
This process was carried out over the 18 comparison points (6 grades x 3 
subject areas) and the results were si^ed. 

Another way to thinic of this is to ask of each school, "Is this 
school doing more than its share in contributing to the ni«iiber of high 
scoring pupils in, say, fourth grade mathematics?" If the answer is 
yes, then give the school one point. This process was repeated for each 
subject area in each grade and the number of the points was summed. The 
results of this scoring process are shown In Table 2. 

The distribution of points In Table 2 shows that there is 
considerable variability in the number of times schools exceed the 
district-wide proportions at the 18 comparison points. Forty-four 
percent of the schools meet the criteria more than half of the time. 
Approximately one-third of the schools meet the criteria five to nine 
times, while nearly 20% of the schools scored four or less. Overall, 
Table 2 j shows that some schools are more effective than others, and that 
these schools can be identified. 
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Table 2 



Distribution of FES Hispanic RIH 
Schools Across the Point Scale 





number 


Percent 




Total 


Or 


or 




Points* 


Schools 


Schools 


Percent 


15 


1 


1.6 


1.6 


14 


1 


1.6 


3.2 


13 


4 


6.3 


9.5 


12 


k 


6.3 


15.9 


11 


k 


6.3 


22.2 


10 




22.2 




9 




6.3 


50.8 


8 


5 


7.9 


58.7 


7 


2 


3.2 


61.9 


6 


7 


11.1 


73.0 


5 


5 


7.9 


81.0 


k 


7 


11.1 


92. 1 


3 


2 


3.2 


95.2 


2 


1 


1.6 


96.8 


1 


1 


1.6 


98.4 


0 


1 


1.6 


IQO.O 



*For schools that did not contain data on all six grade levels the 
percentage of actual points earned to total possible points W9S 
calculated and then extrapolated to the full point scale. 
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f 

Numbtr of Points 

Figure t. Distribution of Hispanic RIM Schools Across the Point Scale 

The Information In Table 2 Is graphically displayed In Figure 1 
which highlights the fact that accomplishments are not uniformly spread 
across schools. The smoothed curve in Figure 1 clearly shows that the 
schools separate, thr., ilves into two fairly distinct groups. 

The total number of points Is obviously the sum of the number of 
points accumulated In Reading, Mathematics and Composition across the 
six grade levels. Since the purpose of this paper Is to Identify 
Instructional accomplishments In RIM schools, those schools that show 
accomplishments In a particular subject aris^ are also of interest. Such 
accomplishments could be masl<ed if only the total score Is used to 
Identify an effective school. For example, If a school obtains a point 
in all $U grades of mathematics but does not receive any points In 
Reading or Composition, It would have a total score of six. Such a 
school would fall in the bottom fourth of the distribution and 




would thus not be identified as as an "effective" school. But obviously 
this school i^s doing an outstanding job In Mathematics and should 
therefore be so acknowledged. Also, one may be Interested In taking a 
closer look at schools that do display uneven patterns. These schools 
may be found to be over^emphasizlng one subject at a real cost to 
others. Or, one might look to see If subject areas may be used to 
complement each other. The subject area score patterns are displayed in 
Table 3- 

The subject area patterns In Table 3 allow one to Identify schools 
that are demonstrating Instructional accomplishments In certain subject 
areas but not others. For example, the school with a 1 1 ^ pattern 
appears to be doing quite well in composition h \ exceeded the criterion 
only once In reading and mathematics- This school could be selected as 
an exemplar of composition Instruction. Or, It may be beneficial to 
investigate how this school might compl^nent Its reading program with 
its composition program since the potential for positive generalization 
is highly practicable. The few obvious Inconsistencies, displayed In 
Table ^, mostly Involve one subject area dominating the other two 
subject areas* i.e., one subject area appears strong while the other 
two appear relatively weak. % 
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Table 3 
Subject Area Patterns 



Tot«l 



1$ 
13 



12 



10 



Subject Af#« fofnti 

Compos I tlof) 



of 



5 
S 
3 
5 
3 
S 
5 
3 
^ 
5 
% 
3 
k 
2 
3 
5 
3 
k 
3 
3 
li 
2 
1 
2 
3 
2 
3 
] 
3 
I 

2 
2 
2 
! 

0 

I 

tJ 
I 

0 
0 

e 



9rAd« !«y«U. I.t,^ tn« fChOOl Only h«S tes 
eh« six 9r«d«ft. Stra{$Hc proportional Intt 
to tNi ^-gr^d* pattern to •ttlmtc* th« 6^9r 
wlfH Uts th^ 5 l«v«U of t«st dAt4 



s€or« pattern €«t»U, Thtrt ar* five school* J 



dirt* for f(vf of 
poUtlon was «ppne(j 
d« p#tt«rn« {Schools 
r« txcludfd from t^\% 
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Table k 
Unusual Patterns 







Subject Area Points 




Points 


Reading 


Mathematics 


Compos! t!on 


13 


3 


6 


4 


11 


5 


3 


3 


10 


2 


5 


3 




c 








3 


5 


2 


9 


k 


k 


1 


8 


2 


2 


k 


6 


1 


1* 


t 




1 


1 


4 



How well does the point scale distinguish among various levels of 
instructional accomplishments? Figures 2, 3, and k display the average 
percentage of Hispanic FES pupils school-wide that exceed the white 
pupil mean at each point on the scale for each subject area. Looking at 
Figure 2 we can see that all the schools that scored two points In 
reading have an average of 27? of their pupils scoring above the white 
pupils* mean. Similarly^ for schools with three points^ there was an 
average of 31? of their pupils scoring above the white mean* The boxes 
dra¥4n about the mean represent one standard error and the lines extended 
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Figure 2. Average school-wide pi^centage of pupi H 
exceeding i^hlte pupil mean in reading by 
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from the boxes are two standard errors giving an approximate 95* 
confidence Interval. 

In some cases, there Is no reliable difference between groups of 
schools that differ by a single point. However, one can be reasonably 
confident that there Is a reliable difference between groups of schools 
that differ by more than one point. 

Correlations among the subject areas given In Table 5 confirm what 
Is evident by visual Inspection of the patterns. Correlations between 
subject areas are moderately high the correlations between subject areas 
and the total aggregate are very high. These correlations indicate that 
selecting schools on the basis of the total aggregate would\also select 
most of those schools that had high subject area scores. However, it 
would also miss the distinctive pattern features that are evident within 
and between subject areas. 



Table 5 



Correlations Between Subject Areas 
and Total Aggregate 



Reading 



Mathematics 



Composition 



Total 



Reading 



Mathematics 



.61 



ComposI tion 



.56 



.51 




*The adjusted total was used for cases with missing grade- level 
information. 
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Identifying Effective Schools 

The final step In the process Is to set some point or pattern 
criterion and Identify by name those schools that meet or exceed, for 
example, one criterion could be: 

a. either a total school score of 9 or more, 

b. or, a score of k or more In a subject area 
Setting a cut-off score always involves some degree of 

arbitrariness. Hinc and four are cut-off points that do Identify 
schools where the majority of the grade-by-subject-area Instructional 
programs appear to be relatively effective on a comparison basis. 
Schools meeting the criterion appear to have more consistent 
accomplishments across grade levels and/or subject areas than those 
schools below the cut-off points. When the above criteria are applied 
to the 63 FES Hispanic RIM schools In Los Angeles, 3^ schools (5^*) meet 
these particular criteria. 

Figure 5 displays the same type of information that was given In 
Figures 2, 3, and 4. Here the percentage of pupils exceeding the white 
pupil mean is plotted against the total score broken out by approximate 
<^uart!les. The information displayed here and In Figure 1 suggests that 
a score of 9 is a very reasonable cut-off point for selecting schools. 
Further, one can be reasonably confident that those schools below the 
cut-off are different than those above the cut-off. Using a total score 
of 9 as a cut-off will select those schools that are meeting the 
criteria a majority of the time. It Is also the point where the top 50* 
of the schools would be selected. To also Include those schools that 
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have a score of k or more !n a subject area would add two additional 
schools. 

"Selected/non selected" should not be equated with "accomplishments 
no accomplishments." There are certainty accomplishments In the 
non-selected schools. The procedure simply ranks the schools on 
specified criteria and selects from the top of the list. Further study 
can then Identify RIMS schooling practices that. create the student and 
school performance patterns. Mllazzo, Buchanan, and Schutz (198I) have 
provided a fairly comprehensive list of factors that are likely to 
account for these differences In performance. Factors such as: 

• textbook series used and period of use 

• average length of classroom lesson 

• percentage of textbook lessons completed 

• percentage of substitute teacher days 

• percentage of classroom time controlled by specialist 

• perce»itage of school day spent disciplining students 

• percentage of school day spent directing aide 

are a few that are mentioned by Mllazzo et al., that need to be 
Investigated to determine their effect on student performance. 

Subsequent study of the schools should of course be observant of 
demographic and non-school factors as well. It is unlikely, however, 
that demographic or non-schooling characteristics account for most of 
the variability. The schools are all Hispanic RIM schools with roughly 
equal levels of English- language fluency. Though there are demographic 
variations between these schools, It Is unlikely that they account for 
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the Instructional accompl Ishment differences. Table 6 shows the 
breakdown of selected and not- selected schools by administrative area 
and Indicates that the selection of schools does not appear to be 
related to administrative areas. 
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Table 6 

Number of Selected vs. Not-Selected 
Schools by Administrative Area 



Area 



Selected 



Number of Schools 
Not Selected 



2 

k 
6 

7 

Totals 



2 

7 
0 
18 
_7 
3^ 



1 

10 
1 

13 
J» 

29 



Total 1 



3 
17 
1 

31 

21 

63 



Summary 

One of the procedural principles suggested by Mllazzo et al. for 
analyzing lAI district level data bases In a RiMS or other speclaf 
priority program context Is to Identify those students who register 
instructional accomplishments at or above the average for non-RIM (or 
non-program) students. This study applies the procedure to Hispanic RiM 
schools In the Los Angeles Unified School District relative to the 
accomplishment infocmation yielded by the District's I9SO Survey of 
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Essential Skills. The findings demonstrate that the procedure is 
practical, showing in particular thats 

1. a 5* randan sample of student records is adequate to 
preliminarily Identify such 5Ch<i6ls 

2. the procedure reveals the many ijosi tive accomplishments of the 
special priority program— illM schools 

« 

3. the accomplishments do cluster in some RIM schools «flore than 
others (l!e.. the accomplishments are not ";^;«;;;^y 

across all RIM schools); the procedure Identifies 3^ Hispanic 
RiH schools 

the preceding findings provide sound evidence that schools and 
schooling practices do make a difference lu attaining 
instructional accomplishments 

5. the next logical step is to trcck down the schooling practices 
in the identified schools that contribute to the observed 
pattern of accomplishments 

6. the distribution of schools involved provides a very Kianageable 
basis for follow-up efforts 
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